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10 The present invention concerns a nnethod and device for inserting 

a supplementary item of information, such as a secret watermark, in digital data. 

It also concerns a method and device for decoding such a 
supplementary information item inserted by the insertion method according to 
the invention. 

15 It falls in genera! terms within the technical field of watermarking of 

digital data. 

The proliferation of exchanges of digitized multimedia data by 
computer is assisting the creation and distribution of illicit copies and, in general 
terms, the illegal manipulation of data. 
20 The watermarking of digital data consists of inserting a watermark 

directly in the digitized data. The insertion of this watermark is like the coding of 
a supplementary data item in the digital data. 

A conventional watermarking consists of inserting a visible logo 
when the digital data are images. Nevertheless, this watermark is easy to 
25 remove for a user who wishes to illegally manipulate this image. 

Use is then frequently made of a so-called invisible watermark, 
which must exhibit the following quality factors: 

Said watermark must be imperceptible, that is to say the insertion 
of such a watermark must preserve the perceptual quality of the digital data, for 
30 example the visual quality for images or the auditory quality for audio data. The 
imperceptibility of the watermark also makes it more difficult to pirate it. 

Said watermark must also be indelible, that is to say be statistically 
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undetectable in the watermarked digital data so as to resist intentional attacks 
for destroying the waternnark. 

Said watermark must also be robust vis-a-vis conventional 
processing applied to digital data, such as compression and decompression, 
5 digital/analogue conversion, filtering etc. 

Finally, said watermark must be reliable, that is to say must allow 
a reliable decision with regard to the existence or otherwise of a given 
watermark in given digital data. 

The existing insertion methods are used by modifying the high or 
10 medium frequencies contained in the digital data, notably when these digital 
data represent an image. Modifying solely the high frequencies makes it 
possible to guarantee the invisibility of the inserted watermark. However, such 
watermarks are little robust vis-a-vis distortions, and in particular do not 
withstand conventional compressions, which broadly quantize the spectral 
15 components of medium or high frequency. 

A method of inserting a watermark is known, described in 
European Patent Application No. 0 766 468 in the name of NEC Corporation, in 
which a frequency transformation of the digital data is performed before 
inserting the supplementary information in perceptually significant components. 
20 A reverse frequency transformation gives the watermarked digital data. A 
discrete cosine transformation or a breakdown into sub-bands by a discrete 
wavelet transformation can be applied to all the digital data, for example an 
image. Thereafter the N largest frequency components of the transform are 
modulated in order to insert the supplementary information. Selection of the 
25 perceptually significant components is however difficult to implement. 

The aim of the present invention is principally to improve the 
existing insertion methods and to increase the quality of the watermark inserted, 
notably in terms of imperceptibility and robustness. 

According to a first aspect of the invention, a method of inserting a 
30 supplementary information item, such as a secret watermark, in digital data 
includes the following steps: 

- multi-resolution spectral breakdown of the digital data; 
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- extraction of the components of lowest frequency; 

- choice of a subset of the components of lowest frequency; 

- modulation of the components of said subset in order to insert 
the supplementary information; and 

5 - reverse multi-resolution spectral recomposition of the 

watermarked digital data. 

Correiatively, a device for inserting a supplementary information 
item, such as a secret watermark, in digital data includes: 

- means for the multi-resolution spectral breakdown of the digital 

10 data; 

- extraction means adapted to extract components of lowest 

frequency; 

- choosing means for choosing a subset of the components of 
lowest frequency; 

15 - means of modulating the components of said subset in order to 

insert the supplementary information; and 

- means for the reverse multi-resolution spectral recomposition of 
the watermarked digital data. 

According to this first aspect of the invention, a prior choice is 
20 made through the multi-resolution spectral breakdown and the extraction of the 
components of lowest frequency, which makes it possible to localize the 
modulatable components automatically in a region of the spectaim, rather than 
in the entire spectral domain. This is particularly well adapted to the verification 
of the watermark inserted, for example when it is a case of verifying copyright 
25 over a digitized image. 

In addition, the prior choice of a spectral sub-band of lowest 
frequency, in which certain components are modulated in order to introduce the 
supplementary information, makes it possible to systematically select 
frequency components which are robust vis-a-vis various digital data 
30 compression algorithms and notably vis-a-vis the conventional compression and 
decompression processing used for digital images. 

The Applicant has shown that, whilst it is currently accepted that 
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the low-frequency components allow only very small modulations without 
significant visual distortion on the reconstructed image, it is possible to add a 
supplementary information item by inserting a significant power signal on these 
components in an imperceptible fashion provided that a sufficiently low 
5 resolution level is reached during the multi-resolution spectral breakdown. 

According to a preferred version of the invention, the multi- 
resolution spectral breakdown level is predetermined so that the number of 
components of lowest frequency is between 8x8 and 32 x 32. 

The Applicant showed empirically that a sub-band of this size was 
10 particularly well suited to the insertion of a supplementary information item 
whilst guaranteeing imperceptibility of this supplementary information. 

In addition, the methods strictly speaking of inserting the signal 
representing the supplementary information and detecting this signal will be 
particularly effective by virtue of the significant reduction in the space which can 
15 be modulated with respect to the size of the initial digital data. 

According to an advantageous version of the invention, particularly 
well adapted to the insertion of a watermark in a digital image, at the spectral 
breakdown step, the spectral breakdown is performed by a discrete wavelet 
transformation, and, at the extraction step, the components of the 
20 approximation sub-band are chosen. 

According to another advantageous version of the invention, and 
as an alternative to the previous version, at the spectral breakdown step, the 
digital data are broken down iteratively into an approximation version 
corresponding to a low-pass filtering and a sub-sampling of the digital data or of 
25 a previous approximation version, and a detail version corresponding to the 
subtraction of the approximation version from the digital data or from the 
previous approximative version, and, at the extraction step, the components of 
the approximation version are chosen. 

This breakdown according to a pyramidal scheme is also 
30 particularly well adapted to the breakdown of an image into successive 
approximation sub-bands and guarantees perfect reconstruction of the image 
after insertion of the signal representing the supplementary information. 



According to a preferred version of the invention, at the modulation 
step, the components of said subset are modulated by adding a modulation 
value generated by a pseudo-random function initialized by a digital signal 
representing the supplementary information to be inserted. 

The addition of the supplementary information by means of 
modulation values generated by a pseudo-random function makes it possible to 
mask this information and to reinforce its invisibility in order to make pirating of 
this information more difficult. 

According to an advantageous version of the invention, at the 
choosing step, the subset of components is chosen according to a pseudo- 
random function initialized by a digital signal representing a confidential key 
associated with the supplementary information to be inserted. 

This confidential key makes it possible to choose the modulatable 
coefficients in a pseudo-random fashion and to thus make the inserted 
information more robust vis-a-vis intentional attacks, making its location in the 
frequency spectrum more difficult to identify. The use of a secret key makes it 
possible to reinforce the protection of the signal inserted in the digital data. 

The invention in its first aspect also concerns a method of 
decoding, in watermarked digital data, a supplementary information item, such 
as a secret watermark, inserted in initial digital data according to the insertion 
method according to the first aspect of the invention, including the following 
steps: 

- multi-resolution spectral breakdown of the watermarked digital 
data and initial digital data; 

- extraction of the components of lowest frequency in the 
watermarked and initial digital data; 

- selection of the subset of components chosen at the choosing 
step of said method of insertion in the watermarked and initial digital data; 

- estimating, by subtraction respectively of the components of said 
subset of watermarked digital data from the components of said subset of initial 
digital data, an estimated sequence of modulation values; 

-generation of a presupposed sequence of modulation values 
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inserted at the modulation step of said insertion method; 

- calculation of a correlation value between the estimated 
sequence and the presupposed sequence; and 

- deciding on the similarity or otherwise of the estimated sequence 
5 and presupposed sequence as a function of said correlation value. 

This decoding method thus makes it possible to easily find the 
components of lowest frequency which have been modulated for the insertion of 
the supplementary information in the digital data and to estimate the inserted 
modulation in order to compare it with a presupposed modulation. Such a 
10 decoding method is particularly well adapted to the recognition of copyright over 
ir=i digital data which have possibly been made noisy during their transmission or 

storage. 

Correlatively, a device for decoding, in watermarked digital data, a 
in supplementary information item, such as a secret watermark, inserted in initial 

Srt 15 digital data according to the insertion method according to the first aspect of the 

- invention, comprises: 

\j - means of multi-resolution spectral breakdown of the 

watermarked digital data and initial digital data; 
^ - means of extraction of the components of lowest frequency in the 

20 watermarked and initial digital data; 

- means of selection of the subset of components chosen at the 
choosing step of said method of insertion in the watermarked and initial digital 
data; 

- means of estimating, by subtraction respectively of the 
25 components of said subset of watermarked digital data from the components of 

said subset of initial digital data, an estimated sequence of modulation values; 

- means of generating a presupposed sequence of modulation 
values inserted at the modulation step of said insertion method; 

- means of calculating a correlation value between the estimated 
30 sequence and the presupposed sequence; and 

- means of deciding on the similarity or otherwise of the estimated 
sequence and of the presupposed sequence as a function of said correlation 
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value. 

This decoding device has advantages similar to those of the 
decoding nnethod according to the first aspect of the invention and is particularly 
well adapted to the recognition of copyright over digital data such as a digital 
5 image for example. 

According to a preferred version of this first aspect of the 
invention, which affords a practical and convenient embodiment of the insertion 
method according to the invention, the means of spectral breakdown, 
extraction, choosing, modulation and spectral recomposition of the insertion 
10 device are incorporated in: 

- a microprocessor, 

- a read-only memory containing a program for inserting a 
supplementary information item, and 

- a random access memory containing registers adapted to record 
15 variables modified during the running of the program. 

In a similar fashion, according to a preferred version which affords 
a practical and convenient embodiment of the decoding method according to 
the first aspect of the invention, the means of spectral breakdown, extraction, 
selection, estimation, generation, calculation and decision of the decoding 
20 device are incorporated in: 

- a microprocessor, 

- a read-only memory containing a program for decoding a 
supplementary information item, and 

- a random access memory containing registers adapted to record 
25 variables modified during the running of the program. 

According to a second aspect of the invention, a method of 
inserting a supplementary informafion item, such as a secret watermark, in 
digital data, comprises the following steps: 

- multi-resolution spectral breakdown of the digital data; 
30 - extraction of the components of a frequency sub-band; 

- spectral transformafion of the components of said frequency sub- 
band; 
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- choice of a subset of coefficients of said spectral transformation; 

- modulation of the coefficients of said subset in order to insert the 
supplementary information; 

- reverse spectral transformation of the coefficients including the 
5 subset of modulated coefficients; and 

- reverse multi-resolution spectral recomposition of the 
watermarked digital data, 

Correlatively, a device for inserting a supplementary information 
item, such as a secret watermark, in digital data, comprises: 
10 -means for the multi-resolution spectral breakdown of the digital 

data; 

- extraction means adapted to extract components of a frequency 

sub-band; 

- means for the spectral transformation of the components of said 
1 5 frequency sub-band; 

- choosing means for choosing a subset of coefficients of said 
spectral transformation; 

- means of modulating the coefficients of said subset in order to 
insert the supplementary information; 

20 - means for the reverse spectral transformation of the coefficients 

including the subset of modulated coefficients; and 

- means for the reverse multi-resolution spectral recomposition of 
the watermarked digital data. 

By virtue of this double transformation of the digital data, the 
25 seeking of the coefficients to be modulated is implemented on a limited range of 
frequencies. This is because a prior choice is effected through the multi- 
resolution spectral breakdown, which makes it possible to locate the 
modulatable coefficients automatically in a region of the spectrum, and not 
throughout the entire spectral range. This is particularly well suited to 
30 verification of the inserted watermark, for example when it is a case of verifying 
copyright over a digitized image. 

In addition, the prior choice of a modulatable frequency band 
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makes it possible to systematically select frequency components robust to 

various digital data compression algorithms. 

Finally, the application of a spectral transformation to the 

components of the chosen sub-band guarantees distribution of the 
5 supplementary information inserted subsequently over the entire spatial domain 

of the digital data. In addition, this spectral transformation is performed on a 

sub-band of the initial digital data, of smaller size. This spectral transformation 

is therefore much more rapid than in the known methods in which the spectral 

transformation is performed on all the initial digital data. 
10 According to a preferred version of the invention, at the extraction 

step, the components of the sub-band of lowest frequency are chosen. 

This choice is particularly judicious when it is a case of an image 

digitized in order to subsequently insert the supplementary information in a 

spectral range robust to conventional compression and decompression 
15 methods. 

According to an advantageous version, particulariy well adapted to 
the insertion of a watermark in a digital image, at the spectral breakdown step, 
the spectral breakdown is effected by a discrete wavelet transformation, and, at 
the extraction step, the components of the approximation sub-band are chosen. 

20 The Applicant has shown, whilst it is currently accepted that the 

approximation sub-band, corresponding to the lowest frequencies, affords only 
very small modifications without significant visual distortions on the 
reconstructed image, that it is possible to add a supplementary information item 
on the components of the approximation sub-band in an imperceptible fashion 

25 provided that a sufficiently low resolution level is reached during the multi- 
resolution spectral breakdown. 

Preferably, the wavelet transformation breakdown level is 
predetermined so that the number of components of the approximation sub- 
band is between 8x8 and 32 x 32. 

30 The Applicant showed empirically that a sub-band of this size was 

particulariy well suited to the insertion of a supplementary information item 
whilst guaranteeing imperceptibility of this supplementary information. 



10 



According to a preferred version of the invention, the spectral 
transformation is a discrete cosine transform. 

The use of such a spectral transformation is particularly well 
adapted to the insertion of a watermark in an image and guarantees good 
5 distribution throughout the entire spatial domain of the inserted watermark. 

According to a preferred version of the invention, at the modulation 
step, the coefficients of said subset are modulated by adding a modulation 
value generated by a pseudo-random function initialized by a digital signal 
representing the supplementary information to be inserted. 
10 The addition of the supplementary information by means of 

modulation values generated by a pseudo-random function makes it possible to 
mask this information and to reinforce its invisibility in order to make pirating of 
this information more difficult. 

According to an advantageous version of the invention, at the 
15 choosing step, the subset of coefficients is chosen according to a pseudo- 
random function initialized by a digital signal representing a confidential key 
associated with the supplementary information to be inserted. 

This confidential key makes it possible to choose the modulatable 
coefficients in a pseudo-random fashion and thus to make the inserted 
20 information more robust to intentional attacks by making it more difficult to find 
its location in the frequency spectrum. 

According to a preferred version of this second aspect of the 
invention, which affords a practical and convenient embodiment of the insertion 
method according to the invention, the means of spectral breakdown, 
25 extraction, spectral transformation, choosing, modulation, reverse spectral 
transformation and spectral recomposition of the insertion device are 
incorporated in: 

- a microprocessor, 

- a read-only memory containing a program for inserting a 
30 supplementary information item, and 

- a random access memory containing registers adapted to record 
variables modified during the running of the program. 
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In association with this insertion method, the present invention 
according to its second aspect also relates to a method of decoding, in 
watermarked digital data, a supplementary information item, such as a secret 
watermark, inserted in initial digital data according to said insertion method, 
5 including the following steps: 

- multi-resolution spectral breakdown of the watermarked digital 
data and initial digital data; 

-extraction of the components of a sub-band of frequencies 
respectively in the watermarked and initial digital data; 
10 - spectral transformation of the components of the frequency sub- 

band of the watermarked digital data and initial digital data. 

- selection of the subset of coefficients chosen at the choosing 
step of said method of insertion in the watermarked digital data and initial digital 
data; 

15 - estimating, by subtraction respectively of the coefficients of said 

subset of watermarked digital data from the coefficients of said subset of initial 

digital data, an estimated sequence of modulation values; 

-generation of a presupposed sequence of modulation values 

inserted at the modulation step of said insertion method; 
20 - calculation of a value of correlation between the estimated 

sequence and the presupposed sequence; and 

- deciding on the similarity or otherwise of the estimated sequence 
and presupposed sequence as a function of said correlation value. 

Correlatively, a device for decoding, in watermarked digital data, a 
25 supplementary information item, such as a secret watermark, inserted in initial 
digital data according to the insertion method according to the second aspect of 
the invention, comprises: 

- means of multi-resolution spectral breakdown of the 
watermarked digital data and initial digital data; 

30 - means of extraction of the components of a sub-band of 

frequencies respectively in the watermarked and initial digital data; 

- means for the spectral transformation of the components of the 
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frequency sub-band of the waternnarked digital data and initial digital data; 

- means of selection of the subset of coefficients chosen at the 
choosing step of said method of insertion in the watermarked and initial digital 
data; 

- means of estimating, by subtraction respectively of the 
coefficients of said subset of watermarked digital data from the coefficients of 
said subset of initial digital data, an estimated sequence of modulation values; 

- means of generating a presupposed sequence of modulation 
values inserted at the modulation step of said insertion method; 

- means of calculating a value of correlation between the 
estimated sequence and the presupposed sequence; and 

- means of deciding on the similarity or otherwise of the estimated 
sequence and of the presupposed sequence as a function of said correlation 
value. 

By virtue of the double transformation of the digital data, the 
search for the modulated coefficients is implemented over a limited frequency 
range. This is because the prior choice effected through the multi-resolution 
spectral breakdown makes it possible to locate the modulatable coefficients 
automatically in a region of the spectrum. 

This decoding method and device are particularly well adapted to 
the verification of the inserted watermark, for example when it is a case of 
verifying copyright over a digitized image. 

According to a preferred version of this second aspect of the 
invention which affords a practical and convenient embodiment of the decoding 
method according to the invention, the means of spectral breakdown, 
extraction, spectral transformation, selection, estimation, generation, calculation 
and decision of the decoding device are incorporated in: 

- a microprocessor, 

- a read-only memory containing a program for decoding a 
supplementary information item, and 

- a random access memory containing registers adapted to record 
variables modified during the running of the program. 
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A means of storing information, which can be read by a computer 
or by a microprocessor, integrated or not into an insertion or decoding device, 
optionally removable, stores a program implementing the method of inserting or 
decoding a supplementary information item according to the first and/or second 
5 aspect of the invention. 

The present invention also relates to a digital signal processing 
appliance having means adapted to implement the insertion or decoding 
method according to the first and/or second aspect of the invention, or having 
an insertion or decoding device according to the first and/or second aspect of 
10 the invention. 

The advantages of this processing appliance are identical to those 
disclosed above in relation to the insertion method and device and the decoding 
method and device according to the first and/or second aspect of the invention. 

The insertion method and the decoding method can be 
15 implemented particularly in a digital photographic apparatus, a digital camera, a 
database management system, a computer, a scanner or a medical imaging 
apparatus, notably an X-ray radiography apparatus. 

Correlatively, a digital photographic apparatus, a digital camera, a 
database management system, a computer, a scanner or a medical imaging 
20 apparatus, notably an X-ray radiography apparatus, have an insertion device 
and/or a decoding device according to the invention. 

Said digital photographic apparatus, digital camera, database 
management system, computer, scanner and medical imaging apparatus such 
as an X-ray radiography apparatus have advantages similar to those of the 
25 insertion and decoding methods and devices according to the invention. 

Other particularities and advantages of the invention will also 
emerge from the following description. 

In the accompanying drawings, given by way of non-limitative 

examples: 

30 - Figure 1 is an outline diagram illustrating the insertion of a 

supplementary information item in a digital signal; 

- Figure 2 is a block diagram illustrating an insertion device 
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according to one embodiment of the invention according to a first aspect; 

- Figure 3 is a block diagram illustrating an insertion device 
according to one embodiment of the invention according to a second aspect; 

- Figure 4 is a block diagram illustrating a digital signal processing 
device adapted to implement the methods according to the invention; 

- Figure 5 illustrates schematically a first method of breaking down 
an image into sub-bands; 

- Figure 6 illustrates schematically a second method of breaking 
down an image into sub-bands; 

- Figure 7 is an algorithm for inserting a supplementary information 
item in an image according to a first embodiment of the first aspect of the 
invention; 

- Figure 8 is an algorithm for inserting a supplementary information 
item in an image according to a second embodiment of the first aspect of the 
invention; 

- Figure 9 is a block diagram illustrating a decoding device 
according to one embodiment of the first aspect of the invention; 

-Figure 10 is an algorithm for decoding a supplementary 
information item in an image according to a first embodiment of the first aspect 
of the invention; 

- Figure 11 is an algorithm for decoding a supplementary 
information item in an image according to a second embodiment of the first 
aspect of the invention; 

-Figure 12 is an algorithm for inserting a supplementary 
information item in an image according to one embodiment of the second 
aspect of the invention; 

-Figure 13 is a block diagram illustrating a decoding device 
according to one embodiment of the second aspect of the invention; 

-Figure 14 is an algorithm for decoding a supplementary 
information item in an image according to one embodiment of the second 
aspect of the invention; and 

-Figure 15 is a comparative curve of the robustness to 



15 



compression according to the JPEG standard of a watermark inserted by an 
insertion method according to the second aspect of the invention and by a 
method of the prior art. 

A description will be given first of all of a device for inserting a 
5 supplementary information item in digital data. 

In the following example, and by way of non-limitative example, 
the digital data consist of a series of digital samples representing an image I. 
The image I is for example represented by a series of bytes, each byte value 
representing a pixel of the image I, which can be a black and white image, with 
10 256 grey levels. 

The supplementary information is a secret watermark which it is 
wished to insert in the image I in an imperceptible and robust fashion. This 
secret watermark can for example make it possible to identify the author or 
owner of the image I. This supplementary information is composed in this 
15 example of an identification number S in a certain number of bits, for example 
32 bits, associated with a confidential key K, also defined in a certain number of 
bits. This identification number S and confidential key K will make it possible to 
create, as described below, a modulation signal which will effectively be 
inserted into the image I. The confidential key K can be associated in an 
20 arbitrary fashion with the identification number S. 

In general terms, and as illustrated in Figure 1 , an insertion device 
is similar overall to an encoder 1, which codes, in an image I, a watermark 
defined from S and K. A watermarked image 1' is supplied to the output of the 
encoder 1 . 

25 This image V can undergo a certain number of processings similar 

to the addition of non-linear noise, such as a compression and decompression, 
with or without loss, in order to be transmitted or stored, or a digital to analogue 
conversion in order to be displayed, or a filtering. 

After processing, the image I*, which corresponds to a noisy 

30 version of the watermarked image 1', can be transmitted to a decoder 2 
associated with the encoder 1. This decoder 2 will estimate, in a conventional 
fashion, from the original image I and the supplementary information S, K 
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inserted, the inserted modulation signal W* in the noisy image 1*. This 
modulation signal W* in the noisy image 1* will be supplied to a detector 3, as 
well as the modulation signal W inserted in the image I, in order to evaluate the 
degree of similarity between these two signals W and W* and thus to check the 
5 copyright information for example which has been inserted. This correlation 
measurement will be described in detail in the remainder of the description with 
reference to the decoding device and method. 

In accordance with a first aspect of the invention, and as illustrated 
in Figure 2, the insertion device 1 has: 
10 -means 11 for the multi-resolution spectral breakdown of the 

digital data representing in this example an image I; 

-extraction means 12 adapted to extract components of lowest 

frequency; 

- choosing means 13 for choosing a subset of the components of 
1 5 lowest frequency; 

- means 14 of modulating the components of this subset in order 
to insert the supplementary information; and 

- means 15 for the reverse multi-resolution spectral recomposition 
of the digital data in order to reconstitute a watermarked image W 

20 In accordance with a second aspect of the invention, and as 

illustrated in Figure 3, the insertion device 1 has: 

- means 31 for the multi-resolution spectral breakdown of the 
digital data representing in this example an image I; 

- extraction means 32 adapted to extract components of a 
25 frequency sub-band; 

- means for the spectral transformation 33 of the components of 
this frequency sub-band; 

- choosing means 34 for choosing a subset of the coefficients of 
the spectral transformation; 

30 - means 35 of modulating the coefficients of this subset in order to 

insert the supplementary information; 

- means for the reverse spectral transformation 36 of the 
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coefficients including the subset of modulated coefficients; and 

- means 37 for the reverse multi-resolution spectral recomposition 
of the digital data in order to reconstitute a watermarked image T. 

Preferably, the multi-resolution spectral breakdown means 11, 31 
5 are adapted to perform a discrete wavelet transformation and consist of a circuit 
for breaking down into sub-bands, or analysis circuit, formed by a set of 
analysis filters, respectively associated with decimators by two. This breakdown 
circuit filters the signal of the image I in two directions, into sub-bands of spatial 
high frequencies and low frequencies. The circuit has several successive 
10 analysis units for breaking the image I down into sub-bands according to 
several resolution levels. 

Conventionally, the resolution of a signal is the number of samples 
per unit length used for representing this signal. In the case of an image signal 
I, the resolution of a sub-band is related to the number of samples per unit 
15 length used for represenfing this sub-band horizontally and vertically. The 
resolution depends on the number of decimations performed, the decimation 
factor and the resolution of the initial image. 

This breakdown into sub-bands is well known and the different 
analysis steps used will be stated briefly below, with reference to Figure 5, in 
20 the case of an image I broken down into sub-bands at a breakdown level d 
equal to 3. 

A first analysis unit receives the image signal I and filters it through 
two digital filters, respectively low-pass and high-pass, in a first direction, for 
example horizontal. After passing through decimators by two, the resulting 
25 filtered signals are in turn filtered by two filters, respectively low-pass and high- 
pass, in a second direction, for example vertical. Each signal is once again 
passed through a decimator by two. At the output of this first analysis unit, four 
sub-bands LLi, LHi, HLi and HHi with the highest resolution in the breakdown 
are then obtained. 

30 The sub-band LLi includes the components of low frequency in 

both directions of the image signal I. The sub-band LHi includes the 
components of low frequency in a first direction and high frequency in a second 
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direction of the image signal 1. The sub-band HLi includes the components of 
high frequency in the first direction and the components of low frequency in the 
second direction. Finally, the sub-band HHi includes the components of high 
frequency in both directions. 
5 A second analysis unit in its turn filters the sub-band LLi in order 

to supply, in the same way, four sub-bands LL2, LH2, HL2 and HH2 with an 
intermediate resolution level in the breakdown. Finally, in this example, the sub- 
band LL2 is in its turn analyzed by a third analysis unit in order to supply four 
sub-bands LL3, LH3, HL3 and HH3 with the lowest resolution in this breakdown. 
10 In this way ten sub-bands and three resolution levels are obtained. 

The sub-band with the lowest frequency LL3 is referred to as the approximation 
sub-band and the other sub-bands are detail sub-bands. 
5 Naturally, the number of resolution levels, and consequently of 

J2 sub-bands, can be chosen differently, and can for example be equal to four 

Q 15 resolution levels with thirteen sub-bands. 

The extraction means 12, 32 are next adapted to choose the 
p; components of the sub-band with the lowest frequency in the breakdown of the 

Ca image I, that is to say, in this example, the approximation sub-band LL3. 

Insertion of the watermark S will thus be performed in the low- 
20 frequency sub-band, which is generally little quantized in the image 
compression and decompression processings, so that the robustness of the 
inserted watermark vis-a-vis the distortions which the image undergoes is 
reinforced. 

The Applicant has found that it is possible to add information into 
25 the approximation sub-band imperceptibly provided that a sufficiently low 
resolution level is reached. 

It is then necessary to adjust the number d of breakdown levels 
according to the size of the image I. This is because, for an image I of size N x 
N, the sub-band of very low frequency is in this example of size N/2^ x N/2^. 
30 Preferably, the number d of levels of breakdown by transformation 

into wavelets is predetermined so that the number n of components of the 
approximation sub-band LLd is between 8x8 and 32 x 32. 
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According to tests, it turns out that it is preferable to have n = 16 x 
16, which corresponds to five breakdown levels when the image I has a size N x 
N = 512x512. 

The components ly with 0 < i < N/2 d"'' and 0 < j < N/2'^-1 of the 
5 approximation sub-band LL5 are thus extracted. 

By way of variant, and according to another embodiment of the 
present invention illustrated in Figure 6, the digital data I are broken down 
iteratively into an approximation version corresponding to a low-pass filtering 
and a sub-sampling of the digital data I or of a previous approximation version, 

10 and into a detail version corresponding to the subtraction of the approximation 
version from the digital data or from the previous approximation version. Such a 
scheme of successive pyramidal approximation is proposed by Burt and 
Adelson in "The Laplacian pyramid as a compact image code", IEEE, Trans, on 
Communications, 31(4): 532-540, 1983. This scheme consists of extracting a 

15 low-resolution version of the image I under consideration by low-pass filtering 
and sub-sampling by a factor equal to two in each direction, horizontal and 
vertical. In this way a level 1 approximation is obtained. The level 0 detail 
image, of the same size as the original image I, is produced by the subtraction 
of the level 1 approximation from the original image I. In order to effect this 

20 subtraction, first of all there is predicted, by interpolation of the low-resolution 
version, an image with an identical size to the original image, and secondly this 
predicted image is subtracted from the original image in order to obtain the 
detail image. This scheme can be iterated as many times as necessary on the 
low-resolution image in order to obtain a sufficiently simplified approximation of 

25 the image and allow an invisible insertion of the supplementary information into 
the approximation version. Here, the breakdown is reiterated on the level 1 
approximation version, which is in its turn broken down into a level 2 
approximation version and a level 1 detail version. Next, at the extraction step, 
the version with the lowest resolution is chosen, here the level 2 approximation 

30 version, also formed by a set of components ly, with i and j varying respectively 
over the length of the level 2 approximation image in a first and a second 
direction. 
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In the first aspect of the invention, the means 13 of choosing a 
subset of components ly cooperate with a number generator 16 in a pseudo- 
random function initialized by the digital signal K representing a confidential key 
associated with the supplementary information S to be inserted. 
5 Drawing numbers according to a pseudo-random function makes it 

possible to reinforce the robustness of the inserted watermark by choosing the 
components to be modulated in a pseudo-random fashion. Only knowledge of 
the confidential key and of the pseudo-random function used makes it possible 
to find the very low frequency components which have been modulated. 
10 Likewise, the modulation means 14 cooperate with the generator 

16 of modulation values generated by a pseudo-random function initialized by a 
digital signal S representing additional information to be inserted and having 
means 15 of adding the modulation values to the components of the previously 
chosen subset. 

15 The spectral recomposition means 15 have a conventional 

recomposition circuit comprising a series of synthesis filters associated with 
multipliers by two, so that, after several recomposition levels, in this example 
equal to three, a watermarked image V is supplied at the output of the coder 1 . 

In the second aspect of the invention, the spectral transformation 

20 means 33 are adapted to effect a discrete cosine transform or DCT. 

This DCT transformation, used conventionally in image 
processing, is here used effectively because of its restriction to a small sub- 
band of the image I. This DCT transformation makes it possible subsequently 
to obtain a distribution of the inserted watermark S throughout the spatial 

25 domain of the image I. 

The means 34 of choosing a subset of coefficients cooperate with 
a number generator 38 in a pseudo-random function initialized by the digital 
signal K representing a confidential key associated with the supplementary 
information S to be inserted. 

30 Drawing pseudo-random numbers makes it possible to reinforce 

the robustness of the inserted watermark by choosing the coefficients of the 
DCT to be modulated in a random fashion. Only knowledge of the confidential 
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key and of the pseudo-random function used makes it possible to find the 
coefficients of the DCT which have been modulated. 

Likewise, the modulation means 35 cooperate with the generator 
38 of modulation values generated by a pseudo-random function initialized by a 
5 digital signal S representing additional information to be inserted and having 
means 35 of adding the modulation values to the coefficients of the previously 
chosen subset. 

The reverse spectral transformation means 36 are in this example 
a reverse discrete cosine transformation used normally in image processing. 
10 Likewise, the spectral recomposition means 37 include a 

conventional recomposition circuit comprising a series of synthesis filters 
associated with multipliers by two, so that, after several recomposition levels, in 
this example equal to 3, a watermarked image V is supplied at the output of the 
coder 1. 

15 Preferably, and as illustrated in Figure 4, the means of spectral 

breakdown 11, extraction 12, choosing 13, modulation 14 and spectral 
recomposition 15, as well as the pseudo-random number generator 16, are 
incorporated in a microprocessor or computer 10, a read-only memory 102 
(ROM) containing the program for inserting a supplementary information item S, 

20 and a random access memory 103 (RAM) containing registers adapted to 
record variables modified during the running of the program. 

Likewise, the means of spectral breakdown 31, extraction 32. 
spectral transformation 33. choosing 34, modulation 35 and reverse spectral 
transformation 36 and spectral recomposition 37. as well as the pseudo-random 

25 number generator 38, are incorporated in a microprocessor or computer 10, a 
read-only memory 102 (ROM) containing the program for inserting a 
supplementary information item S, and a random access memory 103 (RAM) 
containing registers adapted to record variables modified during the running of 
the program. 

30 Naturally, the program for inserting a supplementary information 

item can be stored in a hard disk 108 of the computer 10. 

This insertion program can also be stored in whole or in part on a 
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storage means which is removable and not integrated into the computer proper. 
Thus this insertion program can be received and loaded in the read-only 
memory 102 or hard disk 108 by means of a communication network 113 
connected to the computer by means of a communication interface 112. It can 
5 also be envisaged that the program be loaded by means of a disk drive 109 
adapted to read the program instructions previously stored on a diskette 110. 
Naturally, the diskettes can be replaced by any information medium such as a 
fixed-memory compact disc (CD-ROM), a magnetic tape or a memory card. 

A central unit 100 (CPU) makes it possible to execute the 

10 instructions of the insertion program. Thus, on powering-up, the program stored 
in one of the non-volatile memories, for example the read-only memory 102, is 
transferred into a random access memory (RAM) 103, which will also contain 
the variables necessary for implementing the insertion method according to the 
first and second aspects of the invention. 

15 The random access memory 103 can contain notably several 

registers for storing the variables modified during the running of the program. 
Thus it has, by way of example, a register for storing the size of the 
approximation sub-band at each breakdown level, a register for storing the 
pseudo-random number drawn in order to determine the components to be 

20 modulated, a register for storing the subset of components chosen, a register 
for storing the modulation values and a register for storing the modulated 
components. 

A communication bus 101 in a conventional fashion affords 
communication between the different sub-elements of the computer. 

25 The computer 10 also has a screen 104 for displaying for example 

the image I to be watermarked and to serve as an interface with the user, who 
will be able to parameterize certain data for implementing the insertion method, 
using the keyboard 1 14 for example. 

The supply of data, in which it is wished to insert a secret 

30 watermark, for example in order to identify their author, to the computer 10, can 
be performed by different peripherals and notably a digital camera 107 
connected to a graphics card, or a scanner, an X-ray radiography apparatus or 
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any other image acquisition or storage means. 

The communication network 113 can also be adapted to supply a 
digital image to be watermarked. The diskette 110 can likewise contain digital 
data. 

5 By way of variant, a microphone 1 1 1 is connected to the computer 

10 by means of an input-output card 106. The digital data to be watermarked 
will in this variant be an audio signal. 

This insertion device can also be incorporated in any type of digital 
processing apparatus, directly in a digital photographic apparatus or a digital 
10 camera, or be integrated into a database management system In order to 
watermark the digital data stored or processed. 

The insertion method according to the first aspect of the invention 
will now be described with reference notably to Figures 7 and 8. 

According to the invention, the method of inserting a 
15 supplementary information item S, such as a secret watermark, in digital data, 
here an image I, includes the following steps: 

a) multi-resolution spectral breakdown El of the digital data I; 

b) extraction E2 of the components of lowest frequency. 

The insertion method is here applied, by way of example, to an 
20 image I of size N x N with N = 512 bytes. 

The spectral breakdown El is effected in the embodiment of 
Figure 7 by means of a transformation into discrete wavelets. The number d of 
levels of breakdown by a discrete wavelet transformation is predetermined so 
that the number n of components of the approximation sub-band LL is between 
25 8x8 and 32 x 32. 

In this way a threshold value T is fixed, for example 32 x 32, and, 
at each breakdown level, the number n of components of the approximation 
sub-band LL is compared with this threshold value T during a test step E21 . 

If the test is negative, that is to say n is greater than the threshold 
30 value T, the sub-band is broken down at a higher breakdown level. 

In this example, where the image I is square and with a size equal 
to 512 X 512 bytes, a breakdown into sub-bands with decimators by two is used. 
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The size of the sub-band LL, also square, is, at each breakdown level d, equal 
to N/2^ X N/2^. 

By fixing a threshold value T at 32 x 32, a sub-band LL of suitable 
size for a breakdown level d equal to 4 is obtained. 
5 At step E2, the approximation sub-band LL4 of lowest frequency 

formed by the components ly is consequently chosen, with 0 < i < N/2^ - 1 and 0 
<j <N/2^- 1. 

Alternatively, in the embodiment illustrated in Figure 8, the image 
signal I is broken down by a breakdown of the pyramid type as described above 
10 with reference to Figure 6. At each breakdown level, at step E21, the number n 
of components of the approximation obtained is compared with the threshold 
value T, fixed for example at 32 x 32, in order to determine, in the same way as 
for the discrete wavelet transformation, whether the size of the approximation is 
sufficiently small or whether the breakdown must be reiterated at a higher level, 
15 In a step E3. in accordance with the invention a subset of 

components ly of the sub-band of very low frequency extracted is chosen. The 
components to be modulated are thus chosen in a restricted spectral region. 

In these example embodiments, for the modulation, a degree of 
coverage of x% of the sub-band of very low frequency extracted is fixed. For 
20 example, x = 80 is chosen. 

In this example, the subset of components is chosen according to 
a pseudo-random function initialized by a digital signal K representing a 
confidential key associated with the supplementary information S to be inserted. 

An order of scanning of the components ly is defined. When these 
25 components are in a matrix of size N/2^ x N/2^, the order of video scanning is 
chosen for example in a zigzag from the top left corner to the bottom right 
corner. 

For each component ly, at step E31 a drawing is carried out 
according to a predetermined uniform law U, such as a uniform law U on the 
30 interval [0,1], initialized by K, so that a pseudo-random number bk = U(K) 
between 0 and 1 is obtained. 

In a known fashion, a uniform law U on this interval consists of a 
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series of real numbers, uniformly distributed over the interval ]0,1], each interval 
number having the same probability of occurrence. To each initialization value K 
there corresponds a given series of real numbers: this initialization value K can 
be likened to a secret key, knowledge of which makes it possible to identically 
5 reconstitute the series of real numbers. 

At each drawing of bk, that is to say for each successive value of 
the series of real numbers defined by the uniform law U, this number bk is 
compared with the degree of coverage x/100 in a test step E32. If bk is less than 
x/100, here equal to 0.8, the associated component ly is adopted in order to be 
10 modulated. On the other hand, if the number bk is greater than 0.8, the 
associated component ly is now unchanged and reinserted in the very low 
frequency sub-band at a step E33. 

In this particular example, the proportion of components ly which 
are modulated is equal statistically to four fifths of the very low frequency 
1 5 components extracted at step E2. 

Naturally, without a confidential key K. the choice of the 
components to be modulated can be made systematically, for example by 
choosing four coefficients out of five in the running order. It is also possible to 
choose the largest coefficients in magnitude or the first coefficients in the zigzag 
20 running order of the very low frequency sub-band. 

Still according to the invention, the components ly of the subset 
chosen are modulated at step E4 by adding a modulation value generated by a 
pseudo-random function in a step E41 initialized by the digital signal S 
representing the additional information to be inserted. 
25 A Gaussian law G(0,1 ) is used by way of example, initialized in the 

pseudo-random number generator 16 by the signal to be inserted S. 

At step E41, a modulation value Wk = G(S) is drawn for each 
component ly to be modulated, the index k corresponding to the k*^ component 
hj to be modulated in the predefined scanning order. To each initialization signal 
30 S there corresponds a unique predetermined series of modulation values Wk 
with a mean equal to 0 and a standard deviation equal to 1 . 

A correction coefficient a is calculated at step E42. This coefficient 
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a can be constant for all the components ly to be modulated and can typically 
be equal to 1. It ensures invisibility of the inserted information S. 

Modulation of each component ly is obtained by adding, at step 
E4, the modulation value: 
5 Tij = lij + a Wk 

The choice of a constant correction coefficient a is sufficient in 
these example embodiments using a breakdown into wavelets or a breakdown 
of the pyramidal type, given that the components ly have comparable orders of 
magnitude. 

10 The correction coefficient a could also be dependent on the 

components ly, so that the modulation of each component ly is obtained by 
adding, at step E4, the modulation value: 

I'y = Ijj + ay Wk 

The coefficient ay can be weighted according to the value of the 
15 modulated component so that ay = 0.1 x ly. 

The coefficient ay can also correspond to the mean of the values ly 
close to the modulated component. 

It can also take account of the local visibility limit in order to 
provide a psychovisual masking so that the modulation of the components for 
20 inserting the secret watermark does not exceed the maximum visually 
acceptable distortion. 

The modulated components Ty are next reinserted at step E33 into 
the components of very low frequency in place of the initial components ly. 

A test is performed at step E34 in order to check whether all the 
25 components ly of very low frequency have been scanned. 

In the negative, the following component ly in the scanning order is 
considered and the process is reiterated as from step E3 by drawing a new 
pseudo-random number bk in order to determine whether this component ly is to 
be modulated. 

30 When the scanning is terminated, a last reverse multi-resolution 

spectral recomposition step E5 reconstructs the watermarked image W 

In the example embodiment in Figure 7. synthesis filters are used 
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for implementing a reverse wavelet transformation. 

In the example in Figure 8, the watermarked image 1' is 
reconstructed from versions of successive approximations and details. 

By virtue of the insertion method according to the first aspect of 
5 the invention, the inserted watermark S in the image V is much more robust vis- 
a-vis subsequent processings of the image W In addition, the inserted 
modulation is limited to a band of frequencies and checking of the inserted 
watermark will be much more rapid to effect. 

The decoding of the inserted watermark in this first aspect of the 
10 invention will now be described with reference particularly to Figures 9 to 1 1 . 

The decoder 2 (see Figure 1) receives a noisy image I* and it also 
has available the original image I as well as the information S associated with 
the confidential key K. 

As illustrated in Figure 9, the decoding device according to the first 
1 5 aspect of the invention has: 

- means 61 for the multi-resolution spectral breakdown of 
watermarked digital data 1* and initial digital data I; 

- means 62 of extracting the components of lowest frequency in 
the watermarked digital data 1* and initial digital data I; 

20 - means 63 of selecting the subset of components chosen at the 

choosing step E3 of the insertion method previously described from the 
watermarked digital data I* and initial digital data I; 

- means 64 of estimating, by subtraction respectively of the 
components Ty* of said subset of watermarked digital data 1* from the 

25 components ly of said subset of initial digital data I. an estimated sequence W* 
of modulation values Wk*, 

- means 65 of generating a presupposed sequence W of 
modulation values Wk inserted at the modulation step E4 of said insertion 
method; 

30 - means of calculating a correlation value between the estimated 

sequence W* and the presupposed sequence W; and 

- means 68 of deciding on the similarity or not of the estimated 
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sequence W* and the presupposed sequence W according to said correlation 
value. 

In a sinnilar manner to the insertion device, the spectral breakdown 
means 61 can be adapted to perform a discrete wavelet transformation, the 
5 extraction means 62 being adapted to choose the components of the 
approximation sub-band LL. This spectral breakdown was described in detail 
above. 

In a second embodiment of the invention, the spectral breakdown 
means 61 are adapted to break down the initial digital data I and watermarked 
10 digital data I* iteratively into an approximation version corresponding to a low- 
pass filtering and a sub-sampling of the digital data or a previous approximation 
version, and into a detail version corresponding to the subtraction of the 
approximation version from the digital data or from said previous approximation 
version, the extraction means 62 being adapted to choose the components of 
15 the approximation version. 

It will easily be understood that the choice of these spectral 
, breakdown means depends on the type of breakdown used during the insertion 
of the secret information S. 

The means 65 of generating the presupposed sequence W of 
20 modulation values cooperate with a generator 66 generating modulation values 
generated by means of a pseudo-random function initialized by a digital signal S 
representing supplementary information to be decoded. 

This generator 66 is identical to the generator 16 used in the 
insertion device and makes it possible to recalculate the modulation values Wk 
25 using the same Gaussian law G initialized by a digital signal S representing 
supplementary information which it is wished to decode. 

Likewise, the selection means 63 cooperate with a generator 66 of 
numbers bk in accordance with a pseudo-random function initialized by a digital 
signal K representing a confidential key associated with the supplementary 
30 information S to be decoded. 

As illustrated in Figure 4, the means of spectral breakdown 61, 
extraction 62, selection 63, estimation 64, generation 65, calculation 67 and 
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decision 68 are incorporated in a microprocessor 10, a read-only memory 102 
containing a program for decoding a supplementary information item S and a 
random access memory 103 containing registers adapted to record variables 
modified during the running of the program, 
5 The microprocessor 10 and its functioning are identical to those 

described previously for the insertion device and method according to the first 
aspect of the invention. 

The program for decoding a supplementary information item could 
be stored on a hard disk 108 of the computer 10 or be stored wholly or partly on 
10 a storage means which is removable and not integrated into the computer 
proper. 

A central unit 100 (CPU) makes it possible to execute the 
instructions of the decoding program. Thus, on powering-up, the program stored 
in one of the non-volatile memories, for example the read-only memory 102, is 
15 stored in a random access memory (RAM) 103 which will also contain the 
variables necessary for implementing the decoding method according to the 
invention. 

The random access memory 103 can contain notably several 
registers for storing the variables modified during the running of the program. 

20 Thus it has by way of example a register for storing the size of the 
approximation sub-band at each breakdown level, a register for storing the 
pseudo-random number drawn for determining the components to be 
modulated, a register for storing the component subset chosen, a register for 
storing the estimated sequence of modulation values, a register for storing the 

25 presupposed sequence of modulation values and a register for storing the 
calculation of the correlation value. 

The supply of the data in which it is wished to decode a secret 
watermark, for example to identify their author, to the computer 10 can be 
performed by different peripherals and notably a digital camera 107 connected 

30 to a graphics card, or a scanner, an X-ray radiography apparatus or any other 
means of acquiring or storing images. 

The communication network 113 can also be adapted to supply a 
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digital image to be decoded. The diskette 110 can likewise contain digital data. 

This decoding device can also be incorporated in any type of 
digital processing apparatus, directly in a digital photographic apparatus or a 
digital camera, or be integrated into a database management system in order to 
5 decode the digital data stored or processed. 

A description will now be given, in a more detailed fashion, of the 
decoding method according to the invention for decoding a supplementary 
information item S inserted in digital data I according to the insertion method 
according to the first aspect of the invention. 
10 This decoding method includes, with reference to Figures 10 and 

1 1 , the following steps: 

- multi-resolution spectral breakdown E6 of the watermarked 
digital data I* and of the initial digital data I; 

- extraction E7 of the components of lowest frequency from the 
15 watermarked digital data 1* and initial digital data I; 

- selection E8 of the subset of components chosen at the choosing 
step E3 of said insertion method in the watermarked digital data I* and initial 
digital data I; 

- estimating E9. by subtraction respectively of the components of 
20 said subset of watermarked digital data I* from components of said subset of 

initial digital data I, an estimated sequence W* of modulation values; 

-generation E10 of a presupposed sequence W of modulation 
values inserted at the modulation step E4 of said insertion method; 

-calculation Ell of a correlation value between the estimated 
25 sequence W* and the presupposed sequence W; and 

-decision El 2 on the similarity or not of the estimated sequence 
W* and the presupposed sequence W according to said correlation value. 

Figures 10 and 11 illustrate decoding methods which are identical 
apart from their breakdown E6 and extraction E7 steps. 
30 In a first embodiment illustrated in Figure 10, the spectral 

breakdown is performed by a discrete wavelet transformation, and, at the 
extraction step E7, the components of the approximation sub-band LL are 
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chosen. 

Such a decoding method is used when the supplennentary 
information S has been inserted using an insertion method according to the first 
embodiment of the invention described with reference to Figure 7. 
5 In a second embodiment of the decoding method, illustrated in 

Figure 11, during the spectral breakdown E6, the initial digital data I and 
watermarked digital data I* are broken down iteratively into an approximation 
version corresponding to a low-pass filtering and a sub-sampling of the digital 
data or a previous approximation version, and into a detail version 

10 corresponding to the subtraction of the approximation version from the digital 
data or from said previous approximation version, and, at the extraction step 
E7, the components of the approximation version are chosen. 

Such a decoding method is used when the supplementary 
information S has been inserted using an insertion method according to a 

15 second embodiment of the insertion method as described with reference to 
Figure 8. 

In both cases, the multi-resolution spectral breakdown methods 
are identical to those used in the associated insertion method. 

At each breakdown level, it is checked, in a test step E71, whether 
20 the size of the approximation sub-band is less than a threshold value T and, in 
the negative, the spectral breakdown is reiterated at a higher breakdown level. 
The threshold value used T is identical to that used in the insertion method 
described above. 

At the selection step E8, the subset of components is chosen 
25 according to a pseudo-random function initialized by a digital signal K 
representing a confidential key associated with the supplementary information S 
to be decoded. 

A uniform law U is used, identical to that used during the insertion 
method and initialized by the confidential key K in order to find the same series 
30 of pseudo-random real numbers. It is thus possible to find all the components 
I'ij* modulated in the noisy image 1* and the initial components ly which have 
been modulated. 
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For each component ly and 1, * taken in a predetermined scanning 
order of the approximation sub-bands LL of the initial digital data I and 
watermarked digital data 1*, there is effected, in a step E81. a drawing of bk = 
U(K). At a step E82, this number bk is compared with a coverage ratio x/100, 
5 here equal to 0.8. 

If bk is greater than 0.8, the following component in the predefined 
scanning order is passed to directly. 

Otherwise, at step E9, the difference between the components Ijj 
and Tjj* is produced in order to obtain an estimation Wk* of the inserted 
10 modulation values Wk for each modulated component: 




It is tested, in a step E83, whether the scanning of the sub-bands 
LL is terminated. In the negative, steps E8 et seq are reiterated for the following 
1 5 components in the scanning order. 

In this way a sequence W* is obtained, corresponding to the series 
of estimated values Wk*. 

The decoder also has information S and can calculate, in a 
generation step E10, the presupposed sequence W of the modulation values 
20 Wk, that is to say all the Wk values according to the Gaussian law G(S) used 
during the modulation step E4 of the insertion method. 

There is then effected, in a calculation step E11, a measurement 
of correlation between W and W*, for example using a standardized correlation 
measurement: 



25 corriW.W'^) = 



\\W\\x\\W*\\ 



where (W, = w,w, * and \\W\\ = JWJV) 
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The calculation of a degree of similarity by 100 x corr (W, W*) 
makes it possible to decide, in a decision step El 2, on the similarity or not of 
the two sequences W and W*. 
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Above 50%, the correlation is considered to be sufficient to give a 
positive response at the output of the detector 3. Naturally, the closer the 
correlation is to 100%, the nnore reliable is the detection and therefore the 
recognition of an inserted infornnation itenn S. 
5 It should be noted here that the insertion method according to the 

first aspect of the invention gives, at the time of decoding, a degree of similarity 
greater than 75% for various compression algorithms such as JPEG (Joint 
Photographic Expert Group) as far as a quality factor of 5, which corresponds to 
a greatly degraded image. 
10 The insertion method according to the second aspect of the 

invention will now be described with reference notably to Figure 12. 

According to the invention, the method of inserting a 
supplementary information item S, such as a secret watermark, in digital data, 
here an image I, includes the following steps: 
15 a) multi-resolution spectral breakdown El 01 of the digital data I; 

b) extraction El 02 of the components of a frequency sub-band. 

The insertion method is here applied, by way of example, to an 
image I of size N x N with N = 512 bytes. 

The spectral breakdown El 01 is effected for example by means of 
20 a discrete wavelet transformation. The number d of levels of breakdown by 
wavelet transformation is predetermined so that the number n of components of 
the approximation sub-band LL is between 8x8 and 32 x 32 components. 

In this way a threshold value T is fixed, for example 32 x 32, and. 
at each breakdown level, the number n of components of the approximation 
25 sub-band LL is compared with this threshold value T during a test step El 21 . 

If the test is negative, that is to say n is greater than the threshold 
value T. the sub-band is broken down at a higher breakdown level. 

In this example, where the image I is square and with a size equal 
to 512 X 512 bytes, a breakdown into sub-bands with decimators by two is used. 
30 The size of the sub-band LL, also square, is, at each breakdown level d, equal 
to N/2^ X N/2^. 

By fixing a threshold value T at 32 x 32 bytes, a sub-band LL of 
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suitable size for a breakdown level d equal to 4 is obtained. 

At step E102, the approximation sub-band LL4 of low frequency is 
consequently chosen. 

According to the method of the second aspect of the invention, a 
5 spectral transformation of the components of the frequency sub-band LL4 is 
implemented at a step E103. This spectral transformation is here a discrete 
cosine transform or DCT. 

This DCT transformation is effected on a matrix LL4 which is much 
smaller than the original image I. here one sixteenth of the size of the image I. 
10 The transformation is therefore much more rapid. 

It could also be replaced by a fast Fourier transform or FFT. 

At step E104, in accordance with the invention the choice is made 
of a subset of coefficients Xk of the DCT spectral transformation limited to the 
sub-band LL4. The coefficients Xk to be modulated are thus chosen from a 
1 5 restricted set of spectral coefficients. 

A number P of coefficients to be modulated is determined: for 
example, P is equal to (N/2d x N/2d)/2 coefficients. 

The continuous component (DC coefficient) is excluded from the 
set of coefficients to be modulated. 
20 In this example, the subset of coefficients is chosen according to a 

pseudo-random function initialized by a digital signal K representing a 
confidential key associated with the supplementary information S to be inserted. 

Use is for example made of a uniform law U(0,1 ) which, at a given 
initialization value K, associates a series of pseudo-random numbers uniformly 
25 distributed over the interval ]0,1]. In practice, the value 1 is also excluded. 

A drawing is carried out at step E181 according to this 
predetermined uniform U law initialized by K, so that bk = U(K) is obtained for k 
between 1 and P, with bk strictly between 0 and 1 . 

At each drawing E181, the integer part of bk x P is calculated, 
30 which gives an integer number nk = Ent (bkP) between 0 and P-1. It is then 
chosen to modulate the nk*^ coefficient amongst the modulatable coefficients of 
the DCT which are read for example in a zigzag scanning order, from the top 
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left hand corner to the bottom right hand corner of the transformed sub-band 
LL4. In this way a subset of coefficients Xk is obtained, with k varying from 1 to 
P. 

Naturally, without a confidential key K, it is possible to choose the 
5 P largest coefficients in magnitude or the P first coefficients in the zigzag 
running order, always excluding the DC coefficient. 

Still according to the invention, the coefficients Xk of the chosen 
subset are modulated at step E105 by adding a modulation value generated by 
a pseudo-random function in a step E182 initialized by the digital signal S 
10 representing the supplementary information to be inserted. 

By way of example use is made of a Gaussian law G(0,1) 
initialized by the signal to be inserted S. 

At step E182 a drawing is effected of a modulation value Wk = 
G(S) for each coefficient Xk, with k varying between 1 and P. 
15 A correction coefficient a is calculated at step El 83, This 

coefficient a can be constant for all the coefficients Xk to be modulated and can 
typically be equal to 0.1. It ensures invisibility of the inserted information S. 

Modulation of the coefficient Xk is of obtained by adding at step 
El 05 the modulation value: 
20 X'k = Xk (1 + awk) 

A test is carried out at step El 52 in order to verify whether all the 
coefficients Xk of the chosen subset have been modulated. 

If not, the following coefficient Xk+i is considered and the process 
is repeated as from step El 82 by drawing a new modulation value Wk+i. 
25 When the scanning is ended, a reverse spectral transformation is 

carried out at step El 06. here a reverse DCT, of the coefficients of the sub- 
band LL4 including the subset of modulated coefficients XV. 

Then a last reverse multi-resolution spectral recomposition step 
El 07, by using synthesis filters when it is a case as here of a reverse wavelet 
30 transformation, gives the watermarked image W 

By virtue of the insertion method according to the second aspect 
of the invention, the watermark S inserted in the image 1' is much more robust to 
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subsequent processing of the image 1'. It is distributed throughout the entire 
spatial donnain of the image \\ but the inserted modulation is limited to a 
frequency band. 

The decoding of an inserted watermark in this second aspect of 
5 the invention will now be described with reference particularly to Figures 13 and 
14. 

The decoder 2 (see Figure 1) receives a noisy image 1* and it also 
has available the original image I as well as information S associated with the 
confidential key K. 

10 As illustrated in Figure 13, the decoding device according to the 

second aspect of the invention has: 

- means 21 for the multi-resolution spectral breakdown of 
watermarked digital data I* and initial digital data I; 

- means 22 of extracting the components of a frequency sub-band 
15 LL respectively in the watermarked digital data 1* and initial digital data I; 

- means 23 for the spectral transformation of the components of 
the frequency sub-band LL of the watermarked digital data 1* and initial digital 
data I; 

- means 24 of selecting the subset of components chosen at the 
20 choosing step El 04 of said insertion method from the watermarked digital data 

r and initial digital data I; 

- means 25 of estimating, by subtraction respectively of the 
coefficients of said subset of watermarked digital data I* from the coefficients of 
said subset of initial digital data I. an estimated sequence W* of modulation 

25 values, 

- means 26 of generating a presupposed sequence W of 
modulation values inserted at the modulation step E105 of said insertion 
method; 

- means 28 of calculating a value of correlation between the 
30 estimated sequence W* and the presupposed sequence W; and 

- means 29 of deciding on the similarity or not of the estimated 
sequence W* and the presupposed sequence W according to said correlation 
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value. 

In a similar manner to the insertion device, the extraction means 
22 are adapted to choose the components of the sub-band with the lowest 
frequency LL. 

5 In this example, the multi-resolution spectral breakdown means 21 

are adapted to effect a discrete wavelet transformation, the extraction means 22 
being adapted to choose the components of the approximation sub-band LL. 
This spectral breakdown was described in detail above and is Implemented by 
the decoding device in the same way as the insertion device described 
10 previously in reference to Figure 3. 

Naturally, if a spectral breakdown of the pyramidal type is 
implemented by the insertion device, the associated decoding device will also 
use the same type of pyramidal breakdown for decoding the supplementary 
information inserted. 

15 Likewise, the spectral transformation means 23 are adapted to 

produce a discrete cosine transform. 

It will easily be understood that, in general terms, the means of 
spectral breakdown 21, extraction 22 and spectral transformation 23 are 
identical to the means of spectral breakdown 31, extraction 32 and spectral 
20 transformation 33 used in the insertion device for inserting the supplementary 
information S which it is wished to decode. 

The means 26 of generating the presupposed sequence W of 
modulation values cooperate with a generator 27 generating modulation values 
generated by means of a pseudo-random function initialized by a digital signal S 
25 representing supplementary information to be decoded. 

This generator 27 is identical to the generator used in the insertion 
device and makes it possible to recalculate the modulation values Wk using the 
same pseudo-random function. 

Likewise, the selection means 24 cooperate with a generator 27 of 
30 numbers bk in accordance with a pseudo-random function initialized by a digital 
signal K representing a confidential key associated with the supplementary 
information S to be decoded. 
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The means of spectral breakdown 21. extraction 22, spectral 
transformation 23, selection 24, estimation 25, generation 26, calculation 28 
and decision 29 can be incorporated in a microprocessor 10 as illustrated in 
Figure 4. This microprocessor 10 is identical in its structure to that described 
5 previously for the incorporation of the insertion device according to the second 
aspect of the invention. 

A read-only memory 102 contains a program for decoding a 
supplementary information item S and a random access memory 103 contains 
registers adapted to record variables modified during the running of the 
10 program. 

The program for decoding a supplementary information item could 
be stored on a hard disk 108 of the computer 10 or be stored wholly or partly on 
a storage means which is removable and not integrated into the computer 
proper. 

15 A central unit 100 (CPU) makes it possible to execute the 

instructions of the decoding program. 

The random access memory 103 can contain notably several 
registers for storing the variables modified during the running of the program. 
Thus it has by way of example a register for storing the size of the 

20 approximation sub-band at each breakdown level, a register for storing the 
coefficients of the DCT transformation in a predetermined scanning order, a 
register for storing the pseudo-random number drawn for determining the 
components to be modulated, a register for storing the component subset 
chosen, a register for storing the estimated sequence of modulation values, a 

25 register for storing the presupposed sequence of modulation values and a 
register for storing the calculation of the correlation value. 

The supply of the data in which it is wished to decode a secret 
watermark, for example to identify their author, to the computer 10 can be 
performed by different peripherals and notably a digital camera 107 connected 

30 to a graphics card, or a scanner, an X-ray radiography apparatus or any other 
means of acquiring or storing images. 

This decoding device can also be incorporated in any type of 
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digital processing apparatus, directly in a digital photographic apparatus or a 
digital camera, or be integrated into a database management system in order to 
decode the digital data stored or processed. 

A description will now be given, in a more detailed fashion, of the 
5 decoding method according to the invention for decoding a supplementary 
information item S inserted in digital data I according to the insertion method 
according to the second aspect of the invention. 

This decoding method includes, with reference to Figure 14, the 
following steps: 

10 -multi-resolution spectral breakdown El 10 of the watermarked 

digital data 1* and of the initial digital data I; 

-extraction E111 of the components of a frequency sub-band LL 
respectively in the watermarked digital data I* and initial digital data I; 

- spectral transformation El 12 of the components of the frequency 
15 sub-band LL of the watermarked digital data 1* and initial digital data I; 

-selection El 13 of the subset of coefficients chosen at the 
choosing step El 04 of said insertion method from the watermarked digital data 
r and initial digital data I; 

- estimating El 14, by subtraction respectively of the coefficients of 
20 said subset of watermarked digital data I* from coefficients of said subset of 

initial digital data I, an estimated sequence W* of modulation values; 

-generation El 15 of a presupposed sequence W of modulation 
values inserted at the modulation step El 05 of said insertion method; 

- calculation El 16 of a value of correlation between the estimated 
25 sequence W* and the presupposed sequence W; and 

- decision El 17 on the similarity or not of the estimated sequence 
W* and the presupposed sequence W according to said correlation value. 

As in the associated insertion method, at the spectral breakdown 
step E110, the spectral breakdown is effected by means of a discrete wavelet 
30 transformation and, at the extraction step E111, the components of the 
approximation sub-band LL with the lowest frequency are chosen. 

At each breakdown level, it is checked, in a test step E1111, 
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whether the size of the approximation sub-band is less than a threshold value T 
and, in the negative, the spectral breakdown is reiterated at a higher breakdown 
level. The threshold value used T is identical to that used in the insertion 
method described above in reference to Figure 12. 
5 The spectra! transformation is also a discrete cosine transform 

DCT. 

At the selection step E113, the subset of coefficients is chosen 
according to a pseudo-random function initialized by a digital signal K 
representing a confidential key associated with the supplementary information S 
10 to be decoded. 

A uniform law U is used, identical to that used during the insertion 
method and initialized by the confidential key K in order to find the same series 
of pseudo-random real numbers. It is thus possible to find all the coefficients 
X\* modulated in the noisy image 1* and the initial components Xk which have 
15 been modulated in the initial image I. 

More precisely, and as described in detail in the insertion method, 
a drawing is effected, at step El 131 , of a number bk = U(K), and the integer part 
of bkxP is calculated, with P equal to the number of coefficients modulated, nk = 
Ent(bkXP) is obtained, and the nk^ coefficient is selected in the predefined order 
20 of scanning of the coefficients of the DCT both for the noisy image 1* and for the 
initial image I. 

For the subset of selected coefficients, at the estimation step 
El 14, the difference is produced between these coefficients X\* and Xk in order 
to obtain an estimation Wk* of the modulation values Wk, with k varying from 1 to 
25 P, according to the following demodulation formula: 



Where the image 1' has undergone significant distortions and if the 
modulated coefficient Xk is of low amplitude, the estimated value Wk* can be 
30 very large, and therefore aberrant. In practice, it is necessary to restrict this 
value Wk* : for example, if Wk* is greater than a threshold fixed at 5, then the 
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value 1 is allocated to Wk*. 

In this way a sequence W* is obtained, corresponding to the series 
of estimated values Wk*, for k varying between 1 and P. 

At the generation step E115, the presupposed sequence W of 
5 modulation values is generated by a pseudo-random function initialized by a 
digital signal S representing the supplementary information to be decoded. 

The decoder, also having information S available, can in fact 
calculate, in the generation step E115, the presupposed sequence W, that is to 
say all the Wk values, for k varying from 1 to P according to the Gaussian law 
10 G(S) used during the modulation step El 05 of the insertion method. 

There is then effected, in a calculation step El 16, a measurement 
of correlation between W and W*, for example using a standardized correlation 
measurement: 



corr(W,W^) = 



\w\\^\\w-\\ 



15 where {W,W) = Yak^k^k * ^^d \W\ = J(W,W} . 

The calculation of a degree of similarity by 100 x corr(W. W*) 
makes it possible to decide, in a decision step El 17. on the similarity or not of 
the two sequences W and W*. 
20 Above 50%, the correlation is considered to be sufficient to give a 

positive response at the output of the detector 3. Naturally, the closer the 
correlation is to 100%, the more reliable is the detection and therefore the 
recognition of an inserted information item S. 

Figure 15 compares the robustness of the information inserted 
25 according to the insertion method according to the second aspect of the 
invention and a prior method in which the supplementary information is inserted 
using a DCT transformation applied to the entire image I. 

This robustness is represented by the degree of similarity between 
the watermark inserted and the watermark extracted after processing of the 
30 image 1', according to the quality factor of the processing used. 

, In this example, the image 1' has undergone a compression and 
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decompression processing according to the JPEG (Joint Photographic Expert 
Group) standard based on a discrete cosine transformation DCT. 

In the method according to the invention, the breakdown level is 
equal to 5 and, in both cases, the number of modulated coefficients is equal to 
5 128. 

It is found here that the method according to the invention gives a 
degree of similarity of 90% up to a quality factor of 5, which corresponds to a 
highly degraded image, whereas the method of the prior art is appreciably 
below as far as a quality factor of 60. 
10 The insertion methods according to the invention and the 

associated devices thus make it possible to greatly increase the robustness of 
information inserted in digital data in an imperceptible fashion. 

Naturally, the invention is not limited to the examples described 
above, and many modifications can be made to it without departing from the 
1 5 scope of the invention. 

Thus the watermarked digital data could also be audio data. 

In addition, the spectral transformation could be applied to a detail 
sub-band . rather than to the approximation sub-band of the multi-resolution 
spectral breakdown in the second aspect of the invention. 
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